Approximate first-order primal-dual algorithms for saddle point problems

نویسندگان

چکیده

We propose two approximate versions of the first-order primal-dual algorithm (PDA) to solve a class convex-concave saddle point problems. The introduced criteria are easy implement in sense that they only involve subgradient certain function at current iterate. first PDA solves both subproblems inexactly and adopts absolute error criteria, which based on non-negative summable sequences. Assuming one can be solved exactly, second other subproblem approximately relative criterion. criterion involves single parameter range $[0, 1)$, makes method more applicable. For versions, we establish global convergence $O(1/N)$ rate measured by iteration complexity, where $N$ counts number iterations. inexact with show accelerated $O(1/N^2)$ linear under assumptions part underlying functions strongly convex, respectively. Then, prove these also extended general Finally, perform some numerical experiments sparse recovery image processing results demonstrate feasibility superiority proposed methods.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Adaptive Primal-dual Hybrid Gradient Methods for Saddle-point Problems

The Primal-Dual hybrid gradient (PDHG) method is a powerful optimization scheme that breaks complex problems into simple sub-steps. Unfortunately, PDHG methods require the user to choose stepsize parameters, and the speed of convergence is highly sensitive to this choice. We introduce new adaptive PDHG schemes that automatically tune the stepsize parameters for fast convergence without user inp...

متن کامل

Communication-Efficient Distributed Primal-Dual Algorithm for Saddle Point Problem

Primal-dual algorithms, which are proposed to solve reformulated convex-concave saddle point problems, have been proven to be effective for solving a generic class of convex optimization problems, especially when the problems are ill-conditioned. However, the saddle point problem still lacks a distributed optimization framework where primal-dual algorithms can be employed. In this paper, we pro...

متن کامل

A primal-dual algorithm framework for convex saddle-point optimization

In this study, we introduce a primal-dual prediction-correction algorithm framework for convex optimization problems with known saddle-point structure. Our unified frame adds the proximal term with a positive definite weighting matrix. Moreover, different proximal parameters in the frame can derive some existing well-known algorithms and yield a class of new primal-dual schemes. We prove the co...

متن کامل

Domain Decomposition Algorithms for Saddle Point Problems

In this paper, we introduce some domain decomposition methods for saddle point problems with or without a penalty term, such as the Stokes system and the mixed formulation of linear elasticity. We also consider more general nonsymmetric problems, such as the Oseen system, which are no longer saddle point problems but can be studied in the same abstract framework which we adopt. Several approach...

متن کامل

Frank-Wolfe Algorithms for Saddle Point Problems

We extend the Frank-Wolfe (FW) optimization algorithm to solve constrained smooth convex-concave saddle point (SP) problems. Remarkably, the method only requires access to linear minimization oracles. Leveraging recent advances in FW optimization, we provide the first proof of convergence of a FW-type saddle point solver over polytopes, thereby partially answering a 30 year-old conjecture. We a...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Mathematics of Computation

سال: 2021

ISSN: ['1088-6842', '0025-5718']

DOI: https://doi.org/10.1090/mcom/3610